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This  objective  of  this  project  was  to  develop  algorithms,  tools,  and  architectures 
that  will  improve  the  classification  of  complex  systems.  The  approach  was  based  on 
representing  the  system  as  a  network  of  parallel,  autonomous  units,  communicating  via 
messages  that  summarize  the  state  of  neighboring  subsystems.  This  approach  offers 
reduction  in  complexity,  ease  of  programming,  universality,  and  potential  for  parallel 
hardware  implementation.  A  major  part  of  the  effort  focused  on  augmenting  the  tradi¬ 
tional  belief-network  representation  with  non-Bayesian  methods,  qualitative  information, 
variable-strength  defaults  statements,  and  causal  interactions. 
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Our  main  effort  has  concentrated  on  seeking  non-Bayesian  methods  for 
classification,  where  we  have  explored  the  applicability  of  Ordinal  Conditional  Functions 
[1]  and  the  Dempster-Shafer  belief  functions  [2].  The  need  for  such  formalisms  stems 
from  the  fact  that  we  often  do  not  possess  the  probabilistic  knowledge  required  for  full 
Bayesian  analysis.  For  example,  we  may  not  know  the  components’  failure  rates  and, 
which  is  more  often  the  case,  we  may  not  be  able  to  rate  which  among  several  possible 
modes  of  failure  is  likely  to  be  realized  when  a  given  component  fails. 

We  have  concluded  that  such  ignorance  cannot  be  adequately  represented  in  the 
Dempster-Shafer  formalism  and,  moreover,  the  applications  of  belief  functions  methods 
can  lead  to  implausible  test  and  replacement  strategies.  Our  studies  show  that  the  belief 
measure  Bel  computes  the  probability  that  a  given  component  can  be  proven  faulty,  rath¬ 
er  than  the  probability  that  it  is  faulty  [3].  This  shift  in  semantics  leads  to  unpredictable 
and  sometimes  implausible  behavior  and  it  appears  that  strategies  based  on  these  meas¬ 
ures  cannot  be  implemented  safely  [2]. 

Our  evaluation  of  Ordinal  Conditional  Functions  has  been  more  encouraging,  and 
it  led  to  a  major  effort  toward  a  QUALITATIVE  formulation  of  probabilistic  diagnosis. 
The  reasons  for  taking  this  approach  are  several.  First,  when  an  expert  does  not  have  a 
precise  knowledge  of  the  probabilities  involved  in  the  diagnostic  system  a  coarse  qualita¬ 
tive  estimate  of  these  probabilities  would  often  be  adequate.  Second,  the  qualitative  for- 
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mulation  can  utilize  the  machinery  of  symbolic  processing,  thus  offering  a  computational 
advantage  coupled  with  a  more  natural  explanation  facility. 

The  approach  we  have  taken  draws  upon  the  interpretation  of  linguistic 
quantifiers  (e.g.,  likely,  very  likely,  etc,)  as  encodings  of  infinitesimal  probabilities,  to  be 
processed  and  combined  according  to  the  axioms  of  probability  theory,  and  to  be  translat¬ 
ed  back  to  linguistic  form.  The  result  is  a  probabilistically  sound  calculus,  employing  in¬ 
teger  addition,  for  manipulating  order-of- magnitudes  of  disbeliefs.  For  example,  if  we 
make  the  following  correspondence  between  linguistic  expressions  and  e"  : 


/>(A)  =  e° 

A  is  believable 

kM)  =  0 

II 

. — . 

s 

a. 

A  is  unlikely 

K(A)=\ 

P  (A  )  =  e2 

A  is  very  unlikely 

k04)  =  2 

P(A)  =  e 3 

A  is  extremely  unlikely 

*04)  =  3 

then  the  infenitesimal  approximation  yields  a  nonmonotonic  logic  to  reason  about  likeli¬ 
hood.  For  example,  it  can  take  sentences  in  the  form  of  quantified  conditional  sentences, 
e.g.,  "Birds  are  likely  to  fly",  (written  k(-i/I6)=  1),  "Penguins  are  most  likely  birds", 
(written  tc(-i  b  I  p )  =  2),  "Penguins  are  extremely  unlikely  to  fly,"  (written  *(/lp)  =  3) 
and  return  quantified  conclusions  in  the  form  of  "If  x  is  a  penguin-bird  then  x  is  extreme¬ 
ly  unlikely  to  fly"  (written  k  (f  I  p  Ab )  =  3). 

The  basic  k  ranking  system,  as  described  in  Spohn  [1]  requires  the  specification 
of  a  complete  probability  model  before  reasoning  can  commence.  In  other  words,  the 
knowledge  base  must  be  sufficiently  rich  to  define  the  k  associated  with  every  world  w . 
In  practice,  such  specification  might  require  knowledge  that  is  not  readily  available  in 
common  discourse.  For  example,  we  might  be  given  the  information  that  birds  fly  (writ¬ 
ten  tc(-i/lb)=  1)  and  no  information  at  all  about  properties  of  non-birds,  thus  leaving 
k  {f  a— i  b )  unspecified.  Hence,  stronger  inferential  machinery  is  required  for  drawing 
conclusions  from  partially  specified  models,  like  those  associating  a  k  with  isolated  de¬ 
fault  statements. 

Such  machinery  is  provided  by  a  calculus  called  System-Z+,  which  we  have 
developed  in  the  past  year  [3].  The  calculus  admits  fragmentary  sets  of  conditional  sen¬ 
tences,  treats  them  as  constraints  over  the  distribution  of  k(w),  and  infers  only  such  state¬ 
ments  that  are  compelled  to  acquire  high  likelihood  in  the  "most  normal"  distribution 
k(w)  satisfying  these  constraints. 

In  the  second  phase  of  the  project,  we  explored  the  applicability  of  the  qualitative 
reasoning  provided  by  System-Z+  to  problems  of  diagnosis,  with  special  emphasis  on 
distributed  diagnosis.  In  principle,  System-Z+  should  enjoy  a  similar  diagnostic  power  as 
that  of  traditional  Bayesian  networks,  the  aim  being  to  find  a  set  S  of  faults  that  minim- 
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izes  k+(S  I  evidence).  This  is  indeed  the  case  when  we  possess  sufficient  knowledge  to 
specify  a  complete  k+  distribution  and  to  embed  its  dependence  structure  in  a  network 
form.  However,  when  knowledge  is  only  partial,  special  techniques  have  been  developed 
for  mixing  structural  knowledge  (e.g.  independence  constraints)  with  mechanism 
knowledge  (i.e.,  conditional  likelihood  constraints).  One  such  method,  based  on  causal 
stratification  of  rules,  promises  to  provide  the  qualitative  counterpart  of  Bayesian  net¬ 
works. 
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2. 


SPECIFIC  RESULTS 


The  following  results  were  obtained  during  the  period  of  performance: 

-  A  new  representation  of  graphoids  in  the  form  of  “multi-graphs”  was 
developed  and  analyzed  (R-133,  R-126,  R-127). 

-The  application  of  graphical  models  in  statistical  analysis  were  characterized 
and  categorized  using  properties  of  graphoids  (R-97,  R-l  14,  R-142  ,  R-l  16). 

«  Polynomial-time  algorithms  were  developed  to  test  the  consistency  of  asser¬ 
tions  about  dependencies  and  independencies  (R-l  19). 

—  The  application  of  graphoids  to  structure  learning  have  resulted  in  a  universal 
learning  methods  for  certain  graph  structures  and  causal  models  (R-152). 

—  New  formulation  of  “relevance”  relations  were  developed,  with  applications 
to  the  acquisition  of  probabilistic  knowledge  (R-141,  R-142). 

-  A  new  theory  of  default  reasoning  was  developed,  combining  the  benefits  of 
both  the  extensional  and  conditional  interpretations  (R-l 57). 

-  A  tractable  procedure  was  developed  for  testing  the  consistency  of  databases 
containing  a  mixture  of  defeasible  and  strict  sentences  (R-122,  R-I3I,  R-l 39). 

-  Effective  methods  were  developed  for  reasoning  with  inheritance  networks, 
embodying  specificity,  defeat,  chaining  and  causality  (R-l 29,  R-l 37). 

-  Algorithms  were  developed  for  default  reasoning  based  on  the  maximum- 
entropy  principle  (R-l 44). 

-  Methods  of  identifying  useful  structures  in  empirical  data  were  formulated  and 
analyzed  (R-132,  R-142,  R-149  R-152). 

—  A  comparative  study  was  conducted  comparing  Bayesian  and  Belief-Functions 
strategies  in  automated  reasoning  (R-l 36,  R-143). 

—  An  empirical  definition  of  causation  was  formulated,  and  sound  algorithms  for 
discovering  causal  structures  in  statistical  data  were  developed  (R-l 50,  R-l 55, 
R-156). 

-  The  role  of  hidden  variables  in  constraint  network  was  analyzed  and  distributed 
algorithms  for  solving  the  network  consistency  problem  were  developed  (R-l 47, 
R-148). 
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—  A  relational  semantics  was  developed  for  directed  (causal)  constraint  networks, 
and  algorithms  for  organizing  constraints  in  causal  structures  were  devised  (R- 
153). 

--  New  formalisms  for  reasoning  with  variable-strength  defaults  were  developed 
and  shown  to  be  tractable  (R-122,  R-154,  R-161). 

--  A  propositional  semantics  and  tractable  algorithms  were  developed  for  subsets 
of  default  logic.  (R-163,  R-169,  R-170). 

—  A  method  of  interpreting  and  processing  nonmonotonic  causal  rules  was 
developed  (R-171). 
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